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ABSTRACT 

A study investigated the attitudes and beliefs of 
three groups of third- and fourth-grade classroom teachers (special 
education pull-out, bilingual credential ed, and bilingual waivered, 
n=18 per group) concerning the reading assessment of Latino language 
minority students. Data were gathered from semi-structured 
interviews, a written questionnaire, classroom observation, and 
analysis of documents and classroom products related to assessment. 
Results show, in general, a discrepancy between the beliefs of these 
teachers and those underlying many of the new educational initiatives 
in assessment and instruction. In addition, clear differences between 
the groups were found, with the special education teachers 1 attitudes 
most removed from these pedagogical developments* Variance in teacher 
beliefs and practices occurred both within groups and within 
individuals, with few cases in which beliefs and practices were 
entirely consistent. These findings imply that educational reform 
will require not only a change in practices, but also adoption of a 
fundamentally different paradigmatic belief system. Contains 83 
references . (MSE) 
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with Latino Language Minority Students 



Abstract 



Because of the psychometric bias in much of the work on assessment, 
much attention has been focused on the technical aspects of assessment 
to the exclusion of other aspects of the overall literacy context. In particular, 
little attention has been paid to test users, especially in classroom settings. 
To date, little is known about teachers' beliefs and everyday practices 
regarding assessment. There is even less known about how various factors 
such as professional background might influence these beliefs and prac- 
tices. This information is important, especially in light of the changing 
paradigms impacting educational practice and the increasing linguistic and 
cultural diversity in many classrooms. 

Given this knowledge gap, the present study investigated teachers' 
belief systems or mental models and everyday practices regarding the 
nature, funtion, and uses of assessment with a special focus on reading with 
Latino language minority students. These mental models can be seen as 
integrated systems of concepts, scripts, and scenes which function to lend 
meaning to the action systems of classrooms. 

Three groups of teachers (special education pull-out, bilingual 
credentialed, and bilingual waivered) of Latino language minority students 
were included in the study (n = 1 8 per group). Multiple methods were used 
in the investigation, including semi-structured interviews, a written question- 
naire, classroom observation, and analysis of documents and classroom 
products related to assessment. 

It was found that there were clear differences among the groups 
with the special education teachers most unlike the other two groups. In 
addition, there was a general discrepancy between the belief systems of a 
significant proportion of the teachers studied and the more constructivist and 
socioculturally-based principles underlying many recent theoretical and 
reform-based initiatives. The results are discussed in the context of both 
educational reform and teacher training efforts. 
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INTRODUCTION 

One result of current dissatisfaction with tradi- 
tional school-based testing has been the push, espe- 
cially at the national level, for alternative forms of 
assessment (James, 1 987; National Commission on 
Excellence in Education, 1983; Resnick, 1987; 
Resnick & Resnick, 1 992). Briefly, the emphasis has 
shifted from insuring mastery of isolated 
decontextualized facts through repetitive drill to teach- 
ing and learning as an integrated, socially embedded 
process of meaning-making. For example, a recent 
policy document (California Department of Educa- 
tion, 1992) suggests the following: 

Authentic assessment practices ... are likely to 
differ from past ones at the elementary level in 
some surprising ways. They are likely to include 
integrated reading-writing assessments; the 
evaluation of student writings or of other work 
samples collected in portfolios; investigations 
conducted by small groups of students; and the 
staging of hands-on problem-solving activities. 
They are likely to require both on-demand perfor- 
mance from students as well as performances 
completed over extended periods of time. Ques- 
tions on authentic tests will not be jealously 
guarded secrets; they may be known well ahead 
of time. Speed of response will seldom be at a 
premium in the assessment instruments of the 
1 990's; students may demonstrate their scholas- 
tic achievement . . . over an entire term. And 
often, students who consult one another over 
their answers won't be "cheating"; they will be 
collaborating in much the same way that profes- 
sionals in the world of business are expected to 
do. (p. 67) 

It is clear that traditional methods of monitoring 
learning and measuring educational change do not 
align well with this relatively recent constructivist 
emphasis. Traditional assessment has been criti- 
cized for narrowness of content, lack of match to 
instruction, neglect of higher order thinking in favor of 
rote learning, and the restrictiveness of multiple 
choice and other standardized formats (Baker, 1 989; 
Herman, 1989; Shepard, 1990). Others claim that 
traditional testing trivializes instruction, distorts cur- 
riculum, and expropriates valuable teaching time 
(Bracey, 1989; Dorr-Bremme & Herman, 1986; 



Romberg, Zarinnia, & Williams, 1 989; Smith, Edelsky, 
Draper, Rottenberg, & Cherland, 1 991 ; Stake, 1 988). 

However, there is increasing realization that 
reform involves much more than changing practices. 
Successful reform must involve understanding and 
taking into account the underlying paradigmatic be- 
lief systemsof local users, that is, teachers (Hunsaker 
& Johnston, 1 992). Tharp and Gallimore (1 988) have 
described in great detail, in the case study of a 
particular teacher, how long-term and challenging 
the change process can be. 

Currently, there is a surge of interest in the area 
of teacher belief systems (Pajares, 1 992). However, 
at present, there is little information on teacher 
beliefs related to assessment in general and assess- 
ment of language minority students in particular. The 
purpose of the present study, therefore, was to 
investigate this issue, with a particular focus in the 
area of reading. It was hypothesized that teachers' 
beliefs would be influenced by professional training 
as well as by other factors, such as folk theories 
about testing and second language learning, and 
related factors. 

Current Perspectives on Teacher Beliefs 

There is increasing recognition that the beliefs 
that individuals hold are the best indicators of the 
decisions that they make during the course of every- 
day life (Bandura, 1986). This focus on belief sys- 
tems has been usefully exploited by educational 
researchers trying to understand the nature of teach- 
ing and learning in classrooms. There is a growing 
amountof literature thatsuggeststhatthe beliefs that 
teachers hold impact both their perceptions and 
judgments, and that these in turn affect their behav- 
ior in the classroom. Further, these belief systems 
are an essential part of improving both professional 
preparation and later, teaching effectiveness (Ashton, 
1 990; Ashton & Webb, 1 986; Brookhart & Freeman, 
1992; Buchmann, 1984; Clark, 1988; Cole, 1989; 
Dinham&Stritter, 1986; Eisenhart, Shrum, Harding, 
& Cutnbert, 1 988; Fenstermacher, 1 986; Goodman, 
1 988; Nespor, 1 987; Weinstein, 1 988, 1 989; Wilson, 
1990). 
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One of the difficulties in examining teacher 
beliefs, in addition to the fact that they are not directly 
observable, is that there is some disagreement over 
the differences between beliefs and knowledge 
(Clandinin & Connelly, 1 987). In the cognitive science 
literature, there is a significant amount of research on 
individual belief systems, or "mental models," that is, 
integrated systems of concepts, scripts, and scenes 
that lend meaning to the action systems of class- 
rooms. (Gentner & Gentner, 1983; Mayer, Dyck, & 
Cook, 1 984). In the educational literature on teachers, 
there are a variety of terms forthis phenomenon. Clark 
(1988) referred to it as preconceptions or implicit 
theories, defined as 14 eclectic aggregations of cause- 
effect propositions from many sources, rules of thumb, 
generalizations drawn from personal, experience, 
beliefs, values, biases, and prejudices" (p. 5). 

Following the work of Deford (1985) and 
Richardson, Anders, Tidwelll, & Lloyd (1991), a 
constructivist perspective on teacher beliefs was 
adopted for this study. In this perspective, teachers 
are seen as knowing, meaning-making beings, and 
this knowledge and meaning influence their actions. 
A definition compatible with this sociocultural ap- 
proach was developed by Tabachnick & Zeichner 
(1984). Preferring the term teacher perspectives, 
they defined them as M a reflective, socially defined 
interpretation of experience that serves as a basis for 
subsequent action ... a combination of beliefs, 
intentions, interpretations, and behavior that interact 
continually" (Clark & Peterson, 1 986, p. 287). Unlike 
more general ideological beliefs which can be 
decontextualized and abstracted, these are seen as 
situation-specific and action oriented and include 
both the beliefs teachers have about their work 
(goals, purposes, conceptions of children, curricu- 
lum) and the "ways in which they [give] meaning to 
these beliefs by thei r behavior in the classroom" (ibid, 
p. 28). Although we will use the more commonly 
understood term beliefs, we adopted the definition 
above. 

It is unavoidable that belief systems, like all 
cognitive processes, must be inferred from behavior. 
Following earlier work on teacher beliefs (Eisenhart, 



Shrum, Harding, & Cuthbert, 1988; Fenstermacher, 
1 986; Smith & Shepard, 1 988), beliefs were defined 
as propositions accepted as true. Within this frame- 
work, beliefs consist of one or more assertions held 
by informants and realized in the natural language as 
declarative sentences. 

The literature suggests that care must be taken 
in how these beliefs are investigated. For example, 
earlier work (Duffy, 1981; Hoffman & Kugle, 1982) 
has been criticized on methodological grounds be- 
cause it relied exclusively on paper-and-pencil tasks 
(Hoffman & Kugle, 1 982; Richardson, Anders, Tidwell 
& Lloyd, 1991). These critics suggest that paper- 
and-pencil tasks, when used in isolation, do not 
validly measure beliefs. Moreover, this work sug- 
gests that it is important to explore these beliefs not 
only in terms of publicly declared general proposi- 
tions, but in terms of more private or unrecognized 
beliefs as manifested in examples of specific activi- 
ties or situations. 

Recent Trends in Reading and Literacy 

A major focus of the present study on teachers' 
beliefs about assessment was literacy, more specifi- 
cally reading 1 . A cursory review of the literature, as 
well as interactions with practitioners, suggested two 
things. First, there is no consensus, and in fact 
significant disagreement, over theoretical orienta- 
tions or approaches to reading. Second, there ap- 
pear to be two loosely organized but opposing views 
to reading (and by extension, to literacy in general). 
One perspective suggests that reading is a skill, best 
taught in a prespecified, hierarchical fashion with a 
primary emphasis on fluency and decoding, teacher 
control of thecurriculum, and best measured through 
decontextualized standardized assessments. The 
opposing viewpoint suggests that reading is an inter- 
actional process between the reader and him or 
herself, embedded within a specific social context, 
carried out for authentic purposes, and best moni- 
tored through performance on authentic activities 
over time (Hiebert, 1991). These opposing dimen- 
sions have been nicely captured by Poplin (1988a, 
1988b) in her discussion of reductionist and holistic 
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approaches to teaching, learning, and literacy. This 
same continuum is also reflected i n Cummins' (1 989) 
description of transmission and interactive/experi- 
ential pedagogical approaches, specifically as they 
apply to educational practices related to literacy. 
Opposing positions tend to be rooted in a belief that 
suggests that children have to learn to crawl intellec- 
tually before they can walk or run. 

In many ways, educational practices for lit- 
eracy development, especially for low-achieving 
minority students, can be said to be in a transitional 
state. The literature is increasingly filled with ex- 
amples of successful programs for these students 
and with models for change. In general, these mod- 
els and approaches are socioculturally based, draw 
on students' out-of-school expertise and knowledge, 
facilitate active involvement, and provide appropri- 
ate assisted performance on high-level, meaningful, 
and authentic activities (Cummins, 1989; Edelsky, 
Altwerger, & Flores, 1991; Moll, 1990; Tharp, 1989; 
Tharp & Gallimore, 1988). The most common 
instantiation of these approaches in schools is found 
in whole language programs. 

In contrast, many existing school-based pro- 
grams for low-achieving language minority students 
tend to emphasize low-level remedial approaches 
(Allington, 1991). Often, these rely on an extreme 
form of direct instruction based on mastery of dis- 
crete hierarchically ordered skills. In short, while the 
literature is moving in an increasingly holistic/expe- 
riential/meaning-oriented direction, traditional school 
practices continue to reflect a more reductionist 
orientation. 

In general, a parallel situation is found with 
assessment: namely, practice is in a transitional 
state. Specifically, recent literature emphasizes lit- 
eracy as a sociocultural, interactive, and multi-fac- 
eted phenomenon, yet assessment continues to rely 
on static, decontextualized, unidimensional, stan- 
dardized tests (Shepard, 1 991 ). As with the domain 
of reading and literacy, there appears to be a con- 
tinuum of orientations to assessment, which can be 
represented by opposing poles. One perspective 
suggests that learning is represented by mastery of 
discrete abilities, which can be measured in a com- 
parative fashion through formal, teacher-directed 
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standardized tests and procedures. These proce- 
dures are most often used to rank students or to 
pinpoint specific deficits, which are presumed to 
reside within the student and which can then be 
remediated. As suggested by both Cummins (1989) 
and Poplin (1988a, 1988b), an opposing dimension 
views assessment as more of an informal, long-term 
monitoring process that provides an indication of 
student competence on various types of authentic 
activities and is used to guide instruction. Poplin 
termed this orientation a holistic/constructivist per- 
spective, while Cummins labeled it an advocacy- 
oriented perspective. These same authors termed 
the opposing poles reductionistic and legitimization- 
oriented, respectively. As Mehan, Hertweck and 
Miehls (1 986) and Cummins (1 984) have suggested, 
the reductionistic/legitimization-oriented perspective 
is most clearly found in the practices of special 
education programs. Alternatively, the holistic/advo- 
cacy-oriented perspective would be more character- 
istically found in whole language programs. Clearly, 
these orientations parallel the continuum described 
earlier in relation to reading. 

Bilingualism and Biliteracy 

Although linguistic diversity is increasing sig- 
nificantly in public schools, there is considerable 
controversy over how best to treat this diversity 
(Crawford, 1988). In the popular literature, one ex- 
treme of the debate is found in the U.S. English 
organization and its supporters, while the other end 
of the spectrum is captured in the notion of bilingual- 
ism and bilingual education as "empowering" 
(Cummins, 1 986). It is clear that the field of bilingual- 
ism is complex. A major issue at the center of the 
debate over bilingualism has to do with the effective- 
ness of bilingual education. Although there is good 
evidence that well conceived and well implemented 
bilingual programs are effective (Cummins, 1989; 
Krashen & Biber, 1988), there is still a great deal of 
debate and ambivalence regarding bilingual educa- 
tion from a socio-political perspective (Casanova, 
1992; Halcon & de la Luz Reyes, 1992). 

In spite of these debates, the specific issue for 
many schools is the degree to which students' lan- 
guage and culture are incorporated into the school 
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program. Cummins (1 989) has identified two oppos- 
ing dimensions in this regard. On one end of the 
continuum is what is termed an "additive" perspec- 
tive, while at the other end is a "subtractive" perspec- 
tive. Simply stated, an additive perspective views 
bilingualism and biculturalism as positive resources 
to be drawn upon in designing instructional environ- 
ments. In contrast, a subtractive perspective views 
bilingualism and biculturalism as detrimental to the 
educational process. The literature on teacher be- 
liefs suggests that individual beliefs and understand- 
ings in this area should have an important impact on 
classroom behavior and practices. Therefore, al- 
though the issue of assessment was the central 
focus of the present study, it was felt to be critical to 
examine this aspect of teacher beliefs given the 
characteristics of the students discussed by the 
teachers. 

Summary 

Clearly, the preceding review indicates that a 
sociocultural approach dominates the literature on 
effective teaching practices— especially in reading 
and its assessment — forlanguage minority students. 
This same emphasis carries over into the area of 
assessment, including some important national ini- 
tiatives. However, it is also clear that this emphasis 
represents a paradigmatic shift, or change in under- 
lying belief systems, rather than simply a shift from 
one set of practices to another. The types of reform 
implied in the preceding review require significant 
shifts not only in practice, but in the supporting 
theoretical knowledge base or paradigm, including 
the beliefs and understandings of those who would 
ultimately be the end users, that is, teachers. To 
date, more attention has been given to the technical 
characteristics of the alternative forms of assess- 
ment than to those who would use them and the 
social contexts in which they operate. In the research 
that has explored teacher beliefs and understand- 
ings of classroom processes, attention to language 
minority students has been absent. It was the aim of 
the prese nt study to begin to examine just this issue. 



These were our specific research questions: 

1. What are teachers' beliefs about assess- 
ment in the area of reading with Latino 
students? 

2. Do these beliefs vary by professional train- 
ing and affiliation? 

3. Do these beliefs correspond with classroom 
practices? 



METHOD 

Subjects 

All the teachers participating in this study taught 
in urban Southwest classrooms made up primarily of 
Latino language minority students. There were three 
groups of teachers within the sample, consisting of 18 
teachers per group. One group was comprised of 
teachers with bilingual credentials who had success- 
fully undergone the state-required credentialing provi- 
sions for teaching bilingual students. A second group 
of bilingual special education teachers were"waivered" 
bilingual teachers; that is, they taught in bilingual 
classrooms but were not fully credentialed as bilingual 
teachers. 2 Finally, a third group was comprised of 
bilingual special education teachers of learning dis- 
abled, language minority students. All teachers in this 
last group taught in pull-out special education class- 
rooms known as the "resource specialist program," or 
RSP, in California. The differences in training among 
these groups allowed us to explore the suggestion 
that teachers' beliefs and knowledge base may be 
intricately related to specific professional disciplines 
(Rueda, Figueroa, & Ruiz, 1990). 

All teachers who participated were teaching 
primarily Latino language minority students (at least 
85% of the class) in the third- to fourth-grade age 
range. This age range was selected because many 
"early-exit" bilingual programs use this grade level as 
a point to begin transitioning students into all-English 
programs, andthereforeassessinenttakes on added 
importance at this point in students' careers. In 
addition, by this grade students will have been ex- 
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posed to more complex literacy activities, and those 
with problems will have exhibited them by this time. 

AH teachers came from six urban Southern 
California school districts that serve large numbers 
of language minority students. 

Measures 
Interviews 

A semi-structured interview protocol was con- 
structed that was used to examine and probe beliefs 
about assessment. In designing this protocol, we first 
assumed that teachers' knowledge and beliefs can 
best be characterized as personal ortacit ratherthan 
propositional in form (Feiman-Nemser & Flooden, 
1986). That i. personal knowledge is more likely 
stored and reported in the form of stories and inci- 
dents (Smith, Edelsky, Draper, Rottenberg, & 
Cherland, 1991). We further assumed that such 
personal knowledge is best ascertained through 
soliciting examples and stories from teachers and 
then inferring knowledge and beliefs from this case 
knowledge (Richardson, Anders, Tidwell & Lloyd, 
1991; Smith & Shepard, 1988). Informal and clinical 
interviewing methods (McCracken, 1988; Mishler, 
1986; Polkinghorne, 1988) are best suited to these 
principles about the nature of teacher beliefs and 
knowledge and the ways to elicit them. In this type of 
interviewing, the researcher starts with an agenda, 
or list of general topics to coyer, as well as an opening 
statement and open-ended question designed to 
elicit the participants' perspectives without sensitiz- 
ing the participants to any hypotheses of the re- 
searcher. The content, feeling, and work choice of 
the participants' initial response then become the 
structuring mechanisms for the next phase in the 
interview. As the interview progresses through mu- 
tual negotiation, the researchers' agenda is covered 
naturally. If not, in the later stages of the interview, 
more direct questioning can broach the remaining 
topics. 

In this study, the interview agenda developed 
after an initial review of the literature, consultations 
with teachers and other specialists involved in as- 
sessment, and the overall focus of the project. The 



specific domains covered included assessment, lit- 
eracy, bilingualism and biliteracy, and learning prob- 
lems. The resulting interview agenda covered the 
following specific topics: teacher background factors, 
the nature of reading and how children learn to read, 
reading instruction, assessment of reading, student 
factors including language and learning characteris- 
tics, and the sociocultural context (class/school/com- 
munity). 

Survey of Teacher Beliefs and Practices 

Although it was felt that paper-and-pencil sur- 
veys are an inadequate measure of beliefs when 
used in isolation, it was assumed that multiple mea- 
sures of the same phenomenon increase the validity 
of the findings. Therefore : in addition to participating 
in an interview each teacher responded to a written 
survey of classroom assessment practices related to 
assessment derived in part from Wixson & Lipson 
(1991). 3 

Observations 

Classroom observations were carried out in the 
classrooms of a selected number of teachers (four) 
from each group. Thus, a total of twelve teachers 
were selected for this aspect of the study. The intent 
of the observations was to get a general sense of the 
classroom context for each teacher and more of an 
interpretive context for interview and other data. 

Procedures 

Interview and Survey Development and Administration 

The interview questions and format were de- 
veloped after review of the literature and consultation 
with practicing bilingual teachers. All interview ques- 
tions and procedures were pilot tested with teachers 
who were not included in the final sample. After the 
pilot testing, review sessions were held to discuss 
standardization of procedures. 

The interviews were conducted by doctoral 
candidates in a language, literacy, and learning 
program, who had been bilingual teachers. At the 
conclusion of the interview, all participants were 
provided with a certificate for the purchase of 
children's Spanish literature. 
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Interviews lasted from about one hour to three 
hours and were conducted at the school sites. 
Throughout the interview process there was a focus 
on maintaining good rapport. At the end of each 
interview, teachers were asked to fill out the written 
survey. In most cases, this was completed on the 
spot, but in some cases these were collected at a 
later time because of time limitations. 

Observations 

Within each group of teachers, two teachers at 
opposing ends of the continuum with respect to 
assessment (to be described in more detail later) 
were selected for classroom observations based on 
preli mi nary analysis of the survey and interview data. 
These observations were conducted by the same 
doctoral students as above. In each crse, the ob- 
servers had been practicing teachers and were ex- 
perienced with classroom observations for clinical 
supervision purposes. 

Detailed field notes were collected following 
procedures based- on Spradley (1979, 1980). These 
notes were descriptive and interpretive and aimed at 
building an understanding of instruction, curriculum, 
and assessment in each classroom. Visits to each 
classroom had a relatively narrow focus: to charac- 
terize the curriculum, the teaching methods and 
assessment practices specifically related to literacy 
(reading), the overall organization of the classroom, 
and the general contextual features that might help 
interpret other data. 

During the observation periods, observers re- 
corded as many concrete details as possible of what 
was taught, the methods by which it was taught, any 
activities or references to assessment or evaluation, 
and the allocation and sequence of events. Included 
with the notes were maps and charts of physical 
spaces. Worksheets, tests, and other materials were 
collected to supplement the notes. Finally, during 
free time, teachers were informally questioned about 
the activities that were observed and other aspects 
of classroom life related to assessment. The obser- 
vations were of approximately half a day duration per 
teacher. 



Data Analysis 
Interview Data 

All interviews were tape recorded, transcribed, 
coded, and analyzed. These transcriptions were first 
reviewed using Glaser and Strauss' s (1967) and 
Strauss's (1987) constant comparative method to 
create categories in the domains that were tapped by 
the interviews: primarily assessment, bilingualism/ 
biliteracy, and reading. A domain analysis (Spradley, 
1980) was conducted on the coded material. De- 
scriptive codes were used to categorize responses, 
and these codes eventually became the proposi- 
tional summaries used to characterize the data. A 
coding system and simplified scale were thus devel- 
oped for each of the three domains analyzed. 

As an example of this process, the following 
codes were developed for the domain of assess- 
ment: nature of the information to be assessed; 
nature of the assessment procedures used; uses/ 
purposes of assessment; person responsible for 
assessment; and nature of the process (interactive 
vs. non-interactive). Following the development of 
these codes, which were grounded in the transcripts, 
each transcript was segmented into chunks of text. 
These chunks of narrative were marked off when- 
ever they corresponded to any of these categories. 
Finally, each segment of text was evaluated on a 
three-point scale. 0 represented the legitimization- 
oriented/reductionistic end of the continuum, and 2 
represented the "advocacy-oriented/holistic" end. A 
score of 1 represented a teacher response that was 
either mixed or not strongly advocating for either end 
of the continuum. Finally, the ratings were averaged 
foreachteacheroverthe entire interview, resulting in 
a score between 0 and 2. Since preliminary analysis 
suggested that few teachers could be characterized 
as pure types of any given orientation, this procedure 
had the advantage of showing where on the con- 
tinuum theteacherfell. In addition, it permitted taking 
into account all of the relevant transcript data instead 
of only arbitrarily selected portions. Similar proce- 
dures were followed for the domains of bilingualism/ 
biliteracy and for reading. Finally, the ratings in each 
of the three areas were compared both within groups 
and among groups of teachers. 
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Survey Data 

Exploratory factor analysis on the survey was 
used to test the relationship among items. Factors 
were identified when their eigenvalues were at least 
1 .0 and when they yielded loadings of at least three 
items at a value of at least 0.35. The resulting factors 
from this exploratory analysis were then compared 
with the results from the interviews. 



RESULTS 

Interview Data 

The mean group ratings for the three do- 
mains of assessment, reading, and bilingualism are 
found in Table 1 . Each will be discussed in turn. 

Assessment 

The first dimension of the transcript data exam- 
ined focused on assessment, specifically reading 
assessment. 0 indicated a view of assessment as a 
tool for the measurement or evaluation of discrete 
products of learning with minimal attention to context 
or other sociocultural features, and a focir on com- 
parison, discrete scores, and classification. 2 indi- 



cated a view of assessment as a tool to document 
personal accomplishment or the learning process 
over a period of time with little emphasis on scores, 
comparison with others, and classification. 

Although there was a significant amount of 
variance among individual teachers within each 
group, a clear trend was evident. The special edu- 
cation teachers exhibited views closest to a 
legitimization-oriented/reductionist perspective, fol- 
lowed by bilingual waivered teachers and then 
bilingual credentialed teachers. Interestingly, al- 
though the groups appeared to differ from each 
other, none of the groups was noticeably holistically 
oriented with respect to assessment. 

Reading 

The second dimension examined was reading. 
0 indicated a view of reading emphasizing separate 
subsystems, the primacy of form over function, and 
the segmentation of learning in this area into 
decontextualized parts. In contrast, 2 indicated a 
view of reading emphasizing personal construction 
of meaning, function over form, integrated curricu- 
lum with an emphasis on authentic activities, use of 
students' background knowledge to develop les- 
sons, and collaborative activities. 



TABLE ! 

Means and Standard Deviations for Ratings of Interviews on Assessment, Reading, and Bilingualism 

Group 

Dimension Bil. Bil. RSP Total 
Cred. Waivered 

Assessment* .839 .566 .253 .553 

(.507) (.392) (.308) (.470) 

Reading .998 .847 .542 .796 

(.506) (.424) (.375) (.471) 

Bilingualism 1 .1 02 .928 .629 .886 

(.574) (.604) (.526) (.592) 

* In each case, the possible range is from 0 to 2. 
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Although not as pronounced, the same pattern 
was found as with the domain of assessment. That is, 
the special education teachers were more closely 
oriented to a skills/transmission model of reading, 
while the other two groups expressed views which 
were more characteristic of a mixture between the 
two extremes. None of the three groups of teachers 
was closely aligned with an interactive/experiential 
view of reading, although there was significant vari- 
ance within each group. 

BlLINGUALISM 

The final domain probed in the interview was 
bilingualism. 0 indicated a view of bilingualism as 
largely a negative factor in school achievement and 
Seaming. 2 indicated a view of bilingualism as an 
asset to be built upon and fostered in the learning 
process. 

The data suggest that both the bilingual 
credentialed and waivered teachers were somewhat 
more oriented to an additive perspective on bilingual- 
ism and biliteracy, while the special education (RSP) 
teachers were somewhat more oriented to a subtrac- 
tive perspective. However, no group, including the 
bilingual credentialed teachers, was closely aligned 
with an additive perspective on bilingualism. 



The Relationship between Beliefs about Assessment 
and Beliefs about Reading 

Separate scatter plots were created to see how 
beliefs about assessment were related to beliefs 
about reading and about bilingualism. (See figure 1 .) 
First, the individual ratings of beliefs about assess- 
ment were plotted against those about reading for 
each teacher. This procedure created four quadrants, 
which represented the intersecting axes of these two 
sets pf^beliefs. Displayed in this fashion, the graph 
provided an indication of whether a high score in one 
dimension was accompanied by a high score on the 
other dimensior. For example, was a legitimization- 
oriented/reductionist orientation to assessment asso- 
ciated with a skills/transmission orientation to read- 
ing? Similarly, was an advocacy/holistic orientation to 
assessment associated with an interactive/experien- 
tial orientation to reading? If the relationship was 
strong, a high score on one dimension would be 
related to a high score on the other, or a low score on 
one with a low score on the other, and the majority of 
cases would fall within Quadrants II and III. 

Inspection of Figure 1 suggests that a large 
number of cases fell along a diagonal from Quadrant 
III (representing a low score on both dimensions) to 
Quadrant I! (representing a high score on both di- 
mensions) with only five cases falling completely 
outside of these two quadrants. This pattern sug- 
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gests a relationship did exist between beliefs on 
these dimensions. Also notable in Figure 1 is the 
location of the large number of cases in Quadrant II!, 
suggesting beliefs along both dimensions were low. 
In addition to this visual display, a correlation coeffi- 
cient was computed between ratings on assessment 
and on reading, resulting in a coefficient of .734 (p < 
.0001). This suggested a strong relationship be- 
tween orientations on these two dimensions. 

The Relationship between Beliefs about Assessment 
and Beliefs about Bilinguausm 

A similar procedure was followed in order to 
examine the relationship between beliefs about as- 
sessment and about bilingualism/biliteracy. The re- 
sults of this procedure are found in Figure 2. 

Unlike the previous results, the relationship 
between beliefs about assessment and bilingualism 
is less clear. Although a large number of cases fell 
within the expected Quadrants II and III (represent- 
ing a high score on both dimensions or a low score 
on both dimensions), a significant number of cases 
fell within Quadrants I and IV as well. Cases that fell 
outside of Quadrants III and II suggested that for 
these individuals an inverse relationship existed, 
such that a low score on one dimension was associ- 
ated with a high score on the other. For example, 



these outliers represented cases in which individuals 
expressed beliefs about bilingualism characterized 
as additive but beliefs about assessment character- 
ized as legitimization-oriented/reductionistic, or the 
opposite. It appears that the relationship between 
these two dimensions of beliefs was not as strong as 
was the case with the previous two dimensions. This 
was verified by the significant but somewhat weaker 
correlation coefficient between orientations to as- 
sessment and bilingualism (r = .527, p < .0001). 

The strength of the relationship among the 
various dimensions tapped by the interview varied 
among groups but appeared to be strongest for the 
special education teachers. Intercorrelation matri- 
ces with coefficients broken down by group are 
presented in Table 2. 

Survey Data 

Reading Instructional Practices 

An exploratory factor analysis was performed 
on the 1 6 survey questions regarding teachers 1 read- 
ing instructional practices. The factor loadingsforthe 
various items are presented in Table 3. 

There were three interpretable factors: Factor 
1, named Literature, which reflected a literature- 
based curriculum; Factor 2, named Student-Cen- 
tered, which reflected student-centered approaches; 



Figure 2. Ratings of Teachers' Orientations to 

Bilingualism and Assessment 

2^ 



Lkgttmtulonf 



III 



4 



Legend 
£ Bilingual 
^ Wavered Bil. 
0 Special Ed. 



IV 

▲ 



1 



Bilingualism 



q Teachers' Beliefs about Reading Assessment Page 9 

ERIC 1 5 



TABLE 2 

Intercorrelation Matrices of Belief Domains from Interview Data Presented by Group 



Bilingual Credentialed Teachers 

Bilingualism Reading 
Assessment 
Bilingualism 



Bilingualism 



.37 



Reading 



.72" 
.55' 



Bilingual Waivered Teachers 

Bilingualism Reading 
Assessment 
Bilingualism 

RSP (Special Education) Teachers 

Bilingualism Reading 
Assessment 
Bilinguslism 

: p < .05 
: p < .001 



.50' 



.66* 



TABLE 3 



.52' 
.42 



.90" 
.78" 



Factor Loadings from Factor Analysis of Teachers' Instructional Practices in Reading 



Literature 



Factor 1 
Literature 



Factor 2 
Student- 
Centered 



Factor 3 
Skill-Based 



Students have an opportunity to read a wide variety of fictional 
and nonfictional texts. 

I always integrate reading across the curriculum. 

Students engage in sustained, independent reading on a daily basis. 

I use journal writing to develop comprehension and fluency in reading. 

I supplement the basal reading program with literature books. 

Students choose the books they will read for their reading lessons. 

Students spend most of their reading time working in cooperative groups. 

Students are grouped by interest not by ability. 

I emphasize phonic analysis in teaching word recognition. 

I use basal readers as the core of my reading program. 

I use workbooks to reinforce skills. 

I place students in ability groups for reading. 

I encourage students to use invented spelling in their writing. 



.822 

.747 
.682 
.670 
.431 



.701 
.632 
.608 
-.366 
.731 
-.366 
-.518 



.639 
.598 
-.506 
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and Factor 3, named Skill-Based, which reflected 
skill-based instruction. The first two factors appear to 
be related to the interactive/experiential perspective 
on literacy as described in the interview data, while 
the last factor appears to be closely related to the 
skills/transmission perspective. 

Reading Assessment Practices 

A second exploratory factor analysis was per- 
formed on the questions regarding reading assess- 
ment practices. The factor loadings for this analysis 
are presented in Table 4. 

The results showed clear separation of the 
skills-based assessment factor (Factor 1), labeled 
Test-Based, from the holistic approach of assess- 
ment (Factor2), labeled Performance. These closely 
corresponded with the legitimization-oriented/reduc- 
tionist and the advocacy-oriented/holistic perspec- 
tives as described in the interview data. 



Reading Instructional Materials 

The third exploratory factor analysis, on differ- 
ent types of reading instruction materials, yielded 
four interpretable factors: Factor 1, named Holistic, 
which reflected use of integrated materials and ap- 
proaches; Factor 2, named Mixed, which reflected a 
bottom-up orientation and usage of a variety of 
supplemental materials; and Factor 3, named Read- 
ing Experience, which reflected an emphasis on the 
actual process of reading through various materials. 
The results of the analysis are found in Table 5. 

The means and standard deviations of all eight 
factors that emerged from the factor analysis of the 
survey are presented in Table 6. 

A multivariate analysis of variance was used to 
examine the differences among bilingual, waiver, 
and RSP teachers on the eight factors in addition to 
scores derived from the interviews. The overall mul- 
tivariate tests (Pillais, Hotellings, and Wilks) showed 



TABLE 4 



Factor Loadings from Factor Analysis of Teachers' Reading Assessment Practices 

Factor 1 Factor 2 

Test-based Performance 

End of unit basal tests .889 

District-developed skills tests .737 

End of the book basal tests .728 

Skills continua .567 

Standardized tests .526 

Teacher-developed skills tests .521 

Discussion of texts .980 

Written reactions to reading .433 

Monitoring of oral reading .366 
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TABLE 5 



Factor Loadings from Factor Analysis of Teachers' Reading Instructional Materials 



Reader's Theatre 
Predictable Books 
Phonics Workbook 
Dialogue Journals 
SRA Reading Laboratory 
Skills Exercises 
Other 

Process writing 
Sustained Silent Reading 
DLM Materials 
Computer-based instruction 
Big Books 
Systems 80 
Sight Word Activities 
High interest materials 
Public Library Books 
Basal Readers 
Writing Portfolios 
Children's Magazines 



Factor 1 
Holistic 

.593 

,585 
-.571 

.556 
-.496 
-.483 
-.455 

.398 

.390 



Factor 2 
Mixed 



Factor 3 
Reading 
Experience 



.354 



.678 
.632 
.525 
.484 
.466 
.403 



.358 



.725 
.598 
.398 
.397 



TABLE 6 

Means and Standard Deviations of Teacher Groups on Eight Factors Related to 
Reading Assessment, Practices, and Materials 



GROUP 





Bilingual 


Bilingual 


RSP 


Total 


FACTOR 


Credentialed 


Walvered 






Literature 


7.353* 


8.250 


12.188 


9.224 




(3.040") 


(2.864) 


(3.526) 


(3.743) 


Student-Centered 


14.706 


19.111 


18.333 


17.434 




(4.701) 


(4.324) 


(3.361) 


(4.504) 


Skill-Based 


16.722 


13.278 


13.278 


14.426 




(2.421) 


(3.908) 


(3.675) 


(3.714) 


Test-Based 


6.706 


5.833 


3.833 


5.434 




(1.649) 


(1.917) 


(2.706) 


(2.430) 


Performance 


3.235 


2.667 


4.556 


3.491 




(1.562) 


(1.572) 


(1.423) 


(1.694) 


Holistic 


3.824 


2.833 


3.333 


3.321 


(1.237) 


(1.689) 


(1.414) 


(1.491) 


Mixed 


1.722 


1.444 


3.833 


2.333 


(1.487) 


(1.886) 


(1.978) 


(2.065) 


Reading Experience 


2.556 


2.611 


2.333 


2.500 


(1.487) 


(.608) 


(.840) 


(.795) 



Mean 
" Standard Deviation 
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a significance level < .05. This suggested that there 
were significant group mean differencesamong three 
types of teachers (credentialed, waivered, or RSP) 
on at least one of the variables. The results of this 
analysis are presented in Table 7. 

TABLE 7 

Results of Multivariate Analysis of Variance Tests 
on Group Differences on Eight Reading-related 
Factors 

Test name Value Approx. Hypoth. Error Sig. of 

F DF DF F 

Pillais .86848 2.13220 22.00 70.00 .018 

HotelCings 1.97537 2.52409 22.00 66.00 .006 

Wilks .28463 2.33167 22.00 68.00 .010 



Subsequent univariate F-tests showed that the 
literature instructional factor, the student-centered 
instructional factor, the skills-based instructional fac- 
tor, the test-based assessment factor, the perfor- 
mance assessment factor, the mixed instructional 
reading materialsfactor, and the assessment variable 
from the interview were significant at <.05 level. The 
results of these analyses are presented in Table 8. 



Post-hoc One-Way Analyses 

As a follow-up to this last analysis, seven one- 
way ANOVAs with Scheffe post-hoc tests were per- 
formed. The first one-way ANOVA showed that the 
mean score on the HteratureiacXor (related to instruc- 
tional practices around reading) for the RSPs was 
significantly higher than the mean for the bilingual 
credentialed or waivered teachers. This suggests 
that RSP teachers engaged in fewer of these prac- 
tices than the othertwo groups. The second one-way 
ANOVA suggested that the mean score in the stu- 
dent-centered instructional factor for the bilingual 
credentialed teachers was significantly lower than 
the mean score for both the waivered teachers and 
the RSPs. Since a high score represented the read- 
ing instructional practices less likely to be used by 
teachers, it was concluded that the bilingual 
credentialed teachers favored the student-centered 
approaches suggested by this factor, whereas the 
waivered and RSP teachers practiced more skill- 
driven reading instruction. 

The next one-way ANOVAs on the instruction- 
related skills-based factor showed that the mean 
score for the bilingual credentialed teachers was 
significantly higher than that of the waivered or RSP 
teachers, suggesting they were less likely to engage 
in these types of practices. 



TABLE 8 



Results of Univariate Analysis of Variance Tests on Group Differences on Reading-Related Factors 



Data 




Variable 


Hypoth. 


Error 


Hypoth. 


Error 


F 


Sig. of 


Source Domain 


Name 


SS 


SS 


MS 


MS 




F 


Survey 


inst. 


Literature 


194.069 


449.038 


97.034 


10.205 


9.508 


.000 


inst. 


Stud-Cent. 


127.802 


781.900 


63.901 


17.770 


3.596 


.036 




inst. 


Skill-Based 


132.051 


529.608 


66.026 


12.037 


5.485 


.007 




asses. 


Test-Based 


68.782 


211.771 


34.391 


4.813 


7.146 


.002 




asses. 


Performance 


25.017 


106.600 


12.509 


2.428 


5.163 


.010 




mater. 


Holistic 


4.236 


94.871 


2.118 


2.156 


.982 


.383 




mater. 


Mixed 


53.765 


149.938 


26.882 


3.408 


7.889 


.001 




mater. 


Rdg. Exp. 


1.395 


28.350 


.697 


.644 


1.082 


.348 


Interv. 


read. 


Reading 


1.074 


8.515 


.537 


.194 


2.775 


.073 




biting. 


Biling. 


.989 


14.400 


.495 


.328 


1.511 


.232 




asses. 


Assessment 


1.805 


6.555 


.902 


.149 


6.057 


.005 
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The next two one-way ANOVAs, related to 
assessment practices using the variables test-based 
and pefformance, showed thatthe mean score for the 
RSP teachers was significantly different from those of 
the bilingual credentialed or waivered teachers. 

Overall, these analyses suggested significant 
differences between the RSP teachers and the other 
two groups of teachers, while the bilingual 
credentialed and bilingual waivered teachers tended 
riot to differ from each other. Further, these differ- 
ences suggested that the latter two groups tended 
more toward an advocacy-oriented/holistic perspec- 
tive on assessment, while the RSP teachers were 
more oriented toward a legitimization/reductionistic 
perspective. 

The next analysis examined group differences 
with respect to the use of instructional materials 
using the factor, mixed. The analysis demonstrated 
that the RSP teachers scored significantly higher 
than the other two groups of teachers, suggesting 
that perhaps this group of teachers was more eclec- 
tic in their choice of instructional materials. 

The final analysis explored group differences 
that emerged on the interview variable, assessment. 
The results indicated that the RSP teachers had a 
significantly lower mean score than the bilingual 
credentialed teachers, but this mean was not signifi- 
cantly different from that of the bilingual waivered 
teachers. This low score suggested that the RSP 
teachers were more closely aligned with an orienta- 
tion to assessment characterized as legitimization/ 
reductionist. 

Classroom Observations 

In order to illustrate the data collected during 
classroom observations, three teachers will be de- 
scribed here. Two teachers fell on opposite ends of 
the continuum of beliefs related to assessment, while 
one fell in the middle of the continuum. The first 
teacher was a bilingual credentialed teacher, LH, 
who was rated relatively high (1 .92) on the interview 
with respect to assessment, that is, more oriented 
toward an advocacy/holistic perspective. The sec- 



ond teacher, XG, a special education teacher, fell in 
the middle of the continuum (1 .09) on the basis of the 
interview. The third teacher, CM, is a bilingual 
waivered teacher who was rated relatively low (.50) 
on the dimension of assessment based on the inter- 
view, that is, more toward a legitimization/reduction- 
istic perspective. 

Observations from LH's Classroom: A Bilingual 
Credentialed Teacher 

The following excerpt from field notes (observ- 
ers 1 comments are bracketed) in LH's classroom 
provides a sense of the classroom environment and 
the teacher's instantiation of the beliefs expressed in 
the interview: 

The classroom was literally filled with evi- 
dence of the students' active engagement with 
holistic, authentic literacy activities. A large cor- 
ner of the room was sectioned off for the library; 
this consisted of two bookshelves (fourshelves in 
each) filled with books, most of which had 
Garfield's label on them [suggesting consider- 
able institutional support for a literature-based 
program], plus 16 baskets filled with paperback 
books, 12 sets of 5-6 reading books, 6 dish 
drainers filled with student-authored texts (the 
dish drainers served to stand the books up for 
better visual display), and four long shelves with 
dictionaries, reference books, and magazines. 
There was a comfortable couch and two soft 
armchairs for students to relax in. One student 
was reading when I arrived, instead of participat- 
ing in the class activity. I. sat in the library to read 
some of the books, and students approached me 
to show me theirs, or to sit and read beside me. 

Students did not have their own desks in the 
classroom. They kept their journals stacked to- 
gether in the library. The program was organized 
in such a way that there was no need for the 
students to have their "own" space for their "own" 
things; and they did not need their "own" copies 
of texts or other materials. They each had a folder 
atthefrontofthe roomforsamples of their writing. 

Instead of student desks, there were several 
flat tables around the edge of the room, leaving a 
large open space for group activities. On one 
table stood five large pumpkins. The class had 
gone to the store that morning, weighed them and 
calculated their cost. Each cooperative team 
("family") got to spend $3 on a pumpkin; they had 
to weigh thorn to find one for under that amount. 
Other activity centers in the room include: (1) a 
tape recorder with headphones and book/tapes, 
(2) a computer, (3) a container of calculators, and 
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(4) a bucket of other math manipulatives. [There 
was clear evidence of holistic, authentic math 
and science activities that are integrated themati- 
cally into the program, but it seemed that these 
aspects were less developed than the flourishing 
language arts/writing activities; or perhaps they 
were just less visible by their nature.] 

The walls of the room were also "littered with 
print." These materials were about evenly di- 
vided between English and Spanish. {Note: in the 
field notes, approximately 20 different examples 
are listed}. 

[For the book-writing activities, there was 
clear evidence that the students engaged in a 
writing process. In examining students' work and 
talking with the children, I saw evidence of con- 
tent changes as well as surface-level corrections 
before the final copy was typed (usually by the 
teacher at home; sometimes by the students). 

The students seemed to have a sense of 
ownership to the classroom. Many of them came 
up to me, showing me things. There was a 
friendly, relaxed, noisy, bustling feel to the class- 
room. Students clearly had choice over the cur- 
riculum. In addition, students appeared to have a 
choice of language in classroom activities. Both 
Spanish and English were heard as students 
conversed among themselves, and the teacher 
used both languages in instruction as well as in 
more informal interactions with individual stu- 
dents.] 

Students could sign up to be in the book 
group of their choice (to read sets of literature 
books with the teacher). After the group activity, 
the students scattered into their choice of literacy 
activities. Some went to the library to read, others 
to the listening center, others to work with the 
calculators, others to paint outside, others to 
write with the aide;ja small group stayed with the 
teacher to read a fjbok. At 1 1 :50 they cleaned up 
(happily, noisily, easily, with a song to clean by), 
and then went out to lunch. They filtered back in 
on their own at around 12:20 and got out their 
journals. The teacher sat down with her own 
journal to write too. 

[Assessment seems to be built into the pro- 
gram; the program design would suggest that the 
teacher has to have a good sense of where each 
student was at. The charts listing how many 
books each student has completed serve as one 
assessment measure. The sign-up lists for con- 
ferences and for book groups allow the teacher to 
mi nitor who needs to be more engaged in activi- 
ties. The writing folders serve as portfolios (al- 
though it was unclear how or why pieces were 
chosen for them, or how they were used to 
monitor progress). The focus in the classroom 
was clearly on active engagement and produc- 
tion of materials, not on evaluation of work or of 
students at all. All of the students seemed highly 
motivated and very engaged; this motivation 



seems to flow out of the nature of the activities 
and the particular spirit of this teacher. However, 
the means by which the teacher ensures that all 
are engaged and progressing along their own 
development line is more obscure. It may depend 
on the qualities the teacher possesses — her abil- 
ity to keep a holistic view on each child.] 

Observations from XG's Classroom: A Special Edu- 
cation Teacher 

The second set of excerpts from the classroom 
observations was from a teacher whose interview 
data suggested beliefs that included elements of 
both ends of the continuum related to assessment: 

When I arrived, the class was taking state-man- 
dated standardized tests. They had just finished 
one section. The children left independently to 
the bathroom and then returned for the next 
section. Individuals approached the teacher, who 
responded to them in a friendly manner and did 
not seem bothered by a certain degree of "disor- 
der." One of the students gave him her journal to 
read; he read it and responded in writing with a 
content-based comment. XG explained to me 
that he tries to read three tables' journals every 
day and respond. [When I looked through some 
of the journals in the students 1 portfolios, there 
were large variations - a few had many teacher 
comments, and many had none.] 

Mr. G then called for the class' attention, 
explaining to me that "It usually takes three calls 
to get their attention," and read the instructions 
forthe nextsection.Asthestudentstookthetest, 
Mr. G reminded them "Tienes que leer todcf 
("You have to read it all"), and "just read" One 
student asked him about one question; he re- 
sponded "No te puedo decir me hija" ("I can't tell 
you honey"). 

[In examining the student journals, 1 saw 
evidence that XG is attempting to move into 
more holistic, naturalistic responses to the stu- 
dents* writing, but I also found evidence of his 
"falling back" upon traditional, reductionists, sur- 
face-level responses.] On one page of a student 
journal, one word was corrected for spelling, and 
XG wrote "Very nice, I like the way you wrote 
neatly and spelled all the words correctly. Keep 
up the good work. Use all the space available." 
On another page, however, he asked a question 
in response to the student's entry, and on an- 
other he made a brief comment "May the force be 
with you" - in response to the student's entry 
about Star Wars. The entries to the journals 
would suggest that each page was based on a 
teacher prompt. 

Instructions to the class were on the board: 
1 ) Journal, 2) Read - Day of the Dead, 3) color the 
pictures, 4) finish any other work, 5) practice 
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handwriting, 6) read book, 7) write on the com- 
puter. Other things in the room: skeletons on the 
walls; Say No To Drugs pictures; Halloween 
drawings; student photos with inscriptions on 
gravestones; student work displayed on a bulle- 
tin board (math problems, definitions of words, 
19 spelling words, story, ditto on ordering a 
story); computer with Microsoft Word; a few 
science experiments; calendar; one small shelf 
of library books. 

[Analysis of journals, writing folders, and 
(especially) math work that was in the portfolios 
shows more clearly that XG is working from a 
traditional, reductionistic paradigm; although 
there is evidence That he is attempting to move 
away from this approach.] Math - mostly dittos 
and problems, some corrected or self-corrected, 
and judged (as 100%), or with comments such 
as "Perfect," "Great homework." Some with com- 
ments such as "It's too crowded," "I like your hard 
work; use all the paper," "You need to practice." 
Many other pages were uncorrected and with no 
comments - just practice. 

One student's writing folder - 1 ) Page about 
"cuando cruzo la calle" ("when I cross the street)" 
- This was written one sentence at a time, as a list 
down the page. Teacher's comment - "Great! But 
you need to write beHer" (referring to handwrit- 
ing); 2) book written by the student, apparently 
when working with Ms. V. . who team teaches 
with XG; 3) another book written by the student. 
[The books were uncorrected; I saw no evidence 
of writing as a process, there were no drafts or 
evidence of progression, content changes, or 
final editing.] 

Another student's folder - Only one piece: a 
story about "Mi primer dia en Kinder," ("My first 
day in Kindergarten"). Spelling was corrected in 
pencil. No other changes were made. 

A third student's folder - 1) a four-page story 
in pencil, uncorrected; 2) a three-page story 
about the student; 3) a list of 20 sentences about 
"my family," e.g., "Mi familia es inteiigente" ("My 
family is intelligent"); 4) Another list of "Mi familia 
es..." (1 0 sentences); 5) two pages of evaluation, 
on a school form; 6) three pictures of the student's 
family; 7) a xeroxed story; 8) four maps, colored 
in; 9) a copy of lines from a play; and 1 0) a page 
of spelling, each word written ten times. 

[Portfolios varied greatly in the amount and 
type of work included. It was not clear how or 
why or by whom any pieces were selected. 
There were many pages of math problems. 
There was little evidence of writing process. 
Assessment is mostly based on "correctness" of 
responses, in both math and writing, but there is 
some move toward holistic work.] 



Observations from CM's Classroom: A Bilingual 
Waivered Teacher 

The final excerpts provide a glimpse of the 
classioom of a teacher who was rated relatively low 
on the dimension of assessment through the inter- 
view data. 

There were handwriting samples on the 
board. The teacher explained that she reads a 
story in English. Students then write about what 
they understood about it in Spanish. These 
serve as a check on handwriting. [This seems a 
rather odd measure of handwriting - the ex- 
amples did not seem like students were focus- 
ing on handwriting. Did the teacher only say 
these measure "handwriting" because she 
doesn't know what else they measure?] 

Personal dictionaries - The teacher ex- 
plained, They write the word on one page in 
their booklet, and draw the picture. They write a 
sentence with it, and put the page number 
where they got it. And it works!" She explained 
that this way she "keeps control" and "it's (test- 
ing) all in one place." 

Tapes - Students listen daily to a tape in 
wh»ch CM has recorded 50 to 100 words from 
their reading stories of that week. Students write 
down the words. Teacher explained, "That tells 
me if they get the sounds." Students write the 
same list for 3 days, then the teacher checks it 
- "If I see lots of improvement, I write 'muy bien' 
(Very good')." A sample of one student's list 
included 2 long columns of words, 5 words were 
corrected for spelling in red. 

Book Reports - The teacher uses a sample 
form (in file). It is from a commercial set, xeroxed. 
It has blanks for student's name, title of report, 
and the following questions -^Cuando occurio 
el cuento? ^Donde occurio el cuento? ^Los 
personajes principales? £De que se trata el 
libro? iQue parte te gusto mas? <,Por que? 
Also, students keep lists of the books they've 
written reports on. A chart on the board records 
how many books the/ve read. 

On the board are single words on fish 
shapes, single words on whale shapes, and a 
paragraph about Cristobal Colon. The teacher 
explained that these serve as "pre-reading tests, 
what they know about the subject. Then, later 
students write what they know after the unit, to 
measure progress." [I did not see posttest mea- 
sures.] 

Ramona Qulmby "book" - Each student 
had copies of xeroxed pages of a "book" with 
pictures and then blank lines on each page 
(sample in file). The students' task is to write 
about the story and color the pictures. They get 
more points if they "add" their own ideas. The 
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teacher uses this to see how they "follow direc- 
tions." When the book is complete, the parents 
score it, three friends score it, and the aide 
scores it, for a total number of points. The 
teacher explains "Some of them (peers) are so 
critical...! might not notice a mispelled word, but 
they will." 

Indian designs - Students were drawing 
"Indian" designs. One student drew lots of detail. 
The teacher said, "jNo tiene color!" ("It has no 
color!") "jDale color!" ("Give it color!") The stu- 
dent looked unthrilled. The teacher said, 
"Despues me tienes que escribir la historia" 
("Afterwards, you have to write me the story"). 

On the board are words for alphabetical 
order. There are math pages listed to do also. In 
addition, there are 5 vocabulary words on the 
chalkboard. 

Reading test - Students took a reading test 
today (sample in file). It is a commercial test, 
from Macmillan Pub. Co. and tests in standard- 
ized format the following: word recognition, de- 
coding and phonics skills, comprehension and 
vocabulary, and cloze comprehension. It is pre- 
sented in multiple choice format. The teacher 
explained, Tomorrow other students will cor- 
rect it and grade it. That tests comprehension 
and everything." 

[The class appears to have an emphasis on 
following directions, completing work, doing 
"more", keeping busy, and producing.] The 
teacher explains, "I make them work." 

The teacher maintains a record for each 
student with checks for their completed work, 
grade level, etc. She emphasized that she does 
everything with art. [Yet I saw lots of dittos, pre- 
fabricated stuff, and just drawings, not other art 
forms. It's hard to tell what this teacher thinks 
she's measuring, but she does maintain lots of 
records. The categories appear to be a bit 
confused, i.e., whether some things measure 
comprehension, or vocabulary, or handwriting, 
or "creativity."] 

It is clear thai there are significant differences 
among these classrooms. In general, these differ- 
ences appear to correspond to the beliefs expressed 
by each teacher in the teacher interview. For ex- 
ample, the teacher who scored halfway between the 
two opposing poles of the continuum clearly shows 
evidence of trying to incorporate a more holistic 
approach to assessment such as use of portfolios. 
However, careful examination of the contents of 
those portfolios and the teacher's evaluative com- 
ments suggest that he is still operating from a reduc- 
tionists framework. 



It is also evident that assessment is not pre- 
cisely "located" in these classrooms. That is, even 
given the differences in style among these teachers, 
assessment is dispersed through a number of activi- 
ties and formats, ranging from standardized tests to 
simple, ongoing, informal observation. Moreover, it 
appears difficult to separate assessment from the 
curriculum and the classroom organization. How- 
ever, it is the pattern of activities in each class that 
differentiates these classrooms, not so much the 
individual activity of assessment, but how and why it 
is used and how it fits within the teacher's overall 
view of the curriculum and its organization. 



DISCUSSION AND IMPLICATIONS 

There are two general findings that seem to 
stand out in the data. First, there was much variance 
in teachers' assessment beliefs and practices, both 
within and among groups. However, in general there 
is a discrepancy between the beliefs of the teachers 
in the study and those which underlie many of the 
new educational initiatives in assessment and in- 
struction. Second, the RSP (special education) teach- 
ers appeared to be different in their beliefs from the 
other two groups in a direction even further removed 
from these recent developments. 

The variance in teacher beliefs and practices 
seemed to occur at two levels: within group and 
within individuals. Inspection of the data suggests 
that within each group there was heterogeneity re- 
garding beliefs about assessment, as well as about 
reading and literacy. However, it is also true that 
there appeared to be few "pure" cases where the 
beliefs and practices of individual teachers were 
entirely consistent. This inconsistency was evident 
in the observations of XG's classroom, where inno- 
vative practices are in the process of being incorpo- 
rated into classroom activities, yet often in <*n inap- 
propriate way. For example, dialogue journal are 
used with students, but teacher comments reflect 
concern over spelling and form. In a similar fashion, 
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portfolios are being used, but often contain 
worksheets or spelling lists. 

This variance was also found in some areas 
where it might not be expected. For example, it might 
be hypothesized that bilingual credentialed teachers 
(and to a lesse^ degree, waivered teachers), would 
be overwhelmingly at the additive/supportive end of 
the continuum with respect to bilingualism and 
biliteracy. However, the results did not support this, 
and in fact suggested considerable variance along 
this dimension. The reasons for this finding are not 
clear from the present study, but are an area which 
deserves further investigation. 

Since classrooms are complex activity set- 
tings, it can be hypothesized that at least part of this 
variance in beliefs and practices is due to what 
Mehan et al. (1 986 ) termed "institutional constraints." 
As Clark and Peterson (1986) have suggested, 

Teachers' beliefs about reading represent a 
flexible and complex relationship between teach- 
ers' implicit theories and their classroom behav- 
ior Constraints on teacher behavior such as 

mandated curriculum materials, resources, time 
available, habits, and student abilities may inter- 
pose between theory and action and account for 
observed discrepancies, (p. 289) 

The fact that there is a discrepancy between 
teacher beliefs on the whole and current educational 
initiatives is especially interesting given the districts 
from which these teachers came. In each case, 
these districts were considered progressive in terms 
of their support for more holistic, advocacy-oriented, 
experiential types of curriculum and assessment 
activities. Although the budgetary shortages and 
their effects on inservice training and consultation 
cannot be discounted, it cannot be said that there 
had been no previous support for new educational 
initiatives at the district level. 

Especially notable in these findings is the 
marked tendency of the special education teachers 
to embrace beliefs and practices that are highly 
divergent from the direction of recent educational 
reforms and initiatives. It should be noted that stu- 
dents in the RSP (pull-out) classrooms are normally 
considered the least impaired of all special education 
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students. Moreover, there are many from both within 
and outside of the special education field who have 
argued that these students cannot be reliably and 
validly distinguished from other at-risk and low-achiev- 
ing (e.g., Chapter 1 ) students (Ysseldyke, Algozzine, 
Shinn, & McGue, 1982). The most probable hypoth- 
esis for this finding is that professional training pro- 
grams continue to emphasize a pseudo-medical 
orientation, which is reflected in remedial types of 
practices and beliefs. For example, in an earlier 
study, Rueda, Ruiz, & Boothroyd (1992) found spe- 
cial education teachers were likely to attribute learn- 
ing-disabled students' learning problems to pseudo- 
medical causes such as visual-motor processing 
problems and then to act on remediating these 
presumed deficits. In contrast, the special education 
aides were much more likely to attribute learning 
problems to families' economic problems, marital 
disputes, and other more socioculturally-based fac- 
tors. Although there is some movement with respect 
to aligning the field of special education with the 
larger educational reform movement (see, e.g., Ruiz, 
1989), it appears that there is a significant gap 
remaining. 

Implications 

The major implication of this study is focused 
on the issue of educational reform. It is clear that 
there is a gap between the belief systems of many of 
the teachers in this study and many recent instruc- 
tional and assessment initiatives such as those found 
in the New Standards project at the national level or 
the California Language Arts Framework at the state 
level. Clearly, many of these new initiatives involve 
more than a shift in practices; they also involve the 
adoption of a fundamentally different paradigmatic 
belief system. Just as clearly, successful implemen- 
tation of these new initiatives must give clearer 
attention to teachers* existing belief systems and 
understandings. Yet changing underlying paradig- 
matic belief systems is neithersimple nor short-term, 
as indicated earlier. However, there are many stud- 
ies supporting the idea that if teachers are given the 
opportunity to reflect on theirteaching practices, they 
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not only get better at reflection but they also often 
change as well (Beyer, 1984; Bullough, 1989; Clift, 
Houston, & Pugach, 1990; Feiman-Nemser & 
Buchmann, 1986; Smyth, 1989; Tabachnick & 
Zeichner, 1984). This implies that a value system 
must be in place that supports these types of activi- 
ties. Moreover, the opportunities (and resources to 
support those opportunities) must be provided as 
part of restructuring efforts to encourage meaningful 
change. 

Interestingly, the literature suggests that be- 
liefs are unlikely to be replaced unless they prove to 
be inadequate or otherwise unsatisfactory, and this 
is unlikely to happen unless these beliefs are chal- 
lenged and they cannot be assimilated into the 
existing belief system (Posner, Strike, Hewson, & 
Gertzog, 1982). Pajares (1992) has suggested that 
a number of conditions must exist before anomalies 
in belief systems are uncomfortable enough to ac- 
commodate the conflicting information. First, one 
must understand that the new information repre- 
sents an anomaly. Second, one must believe that the 
information should be reconciled with existing be- 
liefs. Third, one must want to reduce the inconsisten- 
cies among the beliefs. Finally, efforts at assimilation 
must be perceived as unsuccessful. As Pajares 
(1992) points out, however, in practice, belief sys- 
tems are seldom challenged by anomalies since 
people (teachers) are generally unaware of these 
anomalies. 

Staff development and school-based training 
programs are often criticized as notoriously unsuc- 
cessful in bringing about attitudinal changes in teach- 
ers. It may be that these efforts approach the prob- 
lem in a reverse fashion. There is some evidence that 
it is more profitable to expend effort in changing 
behavior before attempting to change beliefs or 
attitudes. Guskey (1986) found that when teachers 
were encouraged to engage in innovative practices 
and when they found them successful in boosting 
achievement, significant attitudinal change was 
noted. This same change is not seen, however, 
when teachers do not use the innovations in the first 
place, or if they use them but detect no improvement 
in their students. 



CONCLUSION 

A fundamental assumption of this study was 
that it is at the level of teachers 1 mental models that 
assessment activities can be most profitably studied 
and understood in the face of significantly changing 
paradigms. It is clear that the conceptualization of 
assessment in general and of the assessment of 
literacy in particular is currently undergoing radical 
changes. Although ttjef current emphasis on literacy 
instruction and its assessment encompasses radical 
changes, efforts to bring about these far-reaching 
changes in the classroom have not been overwhelm- 
ingly successful. It is proposed that this change 
cannot be realized by simply introducing and expos- 
ing teachers to new procedures or assessment tech- 
nology. Successful implementation of current ad- 
vances in knowledge can only derive from funda- 
mental investigation and changes in the mental 
models that drive teachers 1 curriculum enactment. 



NOTES 

The focus on reading in this study belies our 
assumption that reading cannot be meaningfully 
separated from the larger phenomenon known as 
literacy. Consistent with the sociocultural founda- 
tions of our work, we view literacy in a framework 
that emphasizes a dynamic, process-oriented, 
contextually defined approach to education in 
general and to literacy in particular. Within this 
orientation, literacy and education are viewed as 
social and cultural practices and actions that vary 
across cultures, communities, and contexts even 
within the same setting (Heap, 1989; Hiebert, 
1 991 ; Santa Barbara Classroom Discourse Group, 
1992; Walsh, 1991). Moreover, there are mul- 
tiple literacies rather than a single literacy, and a 
given individual may be literate in multiple ways 
(Barton, 1991; Gee, 1991; Heath, 1983; 
Robinson, 1987). Seen in this light, then, all 
literacy does not occur in school settings, and 
traditional reading and writing are not the only 
activities that count as literate activity (Bloom & 
Green, 1992). 
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2 In California, these teachers are known as 
"waivered" teachers. Because of the shortage of 
bilingual credentialed teachers, there are provi- 
sions within the state for teachers to apply for a 
waiver, which is a promise to complete the bilin- 
gual credential requirements within a certain pe- 
riod of time. 

3 The interview protocol, written survey questions, 
and coding schemes used in the dataanalysis are 
available from the author on request. 
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